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Abstract: The nonlinearity of a transmission fiber may be compensated by a specialty fiber 
and an optical phase conjugator. Such combination may be used to pre-distort signals before 
each fiber span so to linearize an entire transmission line. 
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A fiber-optic transmission line is a nonlinear channel due to the material nonlinear effects. Fiber nonlinearity 
has become one of the major limiting factors in modern optical transmission systems [f, 2]. Distributed 
Raman amplification and various return-to-zero (RZ) modulation formats may be employed to reduce the 
nonlinear impairments, but merely to a limited extent. It is known that the nonlinearity of one fiber line may 
be compensated by that of another with the help of optical phase conjugation (OPC). However, all previous 
proposals and demonstrations [3, 4, 5, 6, 7] work partially in fighting the fiber nonlinearity. They either are 
specialized to only one aspect of the nonlinear effects, or fail to work in the presence of dispersion slope 
or higher order dispersion effects. Still open to date is an important question: does fiber nonlinearity really 
impose a fundamental limit to the channel capacity? This paper introduces the notion of scaled nonlinearity, 
which together with the application of OPC, provides a negative answer to the above question. 

Consider an optical fiber stretching from z = —L to z = 0, along which the optical birefringence is cither 
vanishingly weak to avoid the effect of polarization mode dispersion (PMD), or sufficiently strong to render 
the fiber polarization maintaining. A set of optical signals arc wavelength-division multiplexed (WDM) and 
injected into the fiber. For simplicity, it is assumed that all the signals are co-lincarly polarized, and coupled 
into one polarization eigen state when the fiber is polarization maintaining. The signals may be represented 
by a sum of scalars E(r, t) = F(x, y) J2 n A n{z, t) exp [i J z u! n )d(^ — iui n t] , where F(x, y) is the transverse 
modal function, Vn £ Z, u) n = luq + nA and A n are the center frequency and the signal envelope of the nth 
WDM channel respectively, A > is the channel spacing, P{z,u>) is the function of propagation constant vs. 

optical frequency u> at the position z in the fiber. Define P^(z,uj) d = -^prP(z,uj), V7c > 0. The dynamics of 
signal propagation may be described by a group of coupled partial differential equations [8, 9], 
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ip ln (2.*^) A n + ^4p-A n = ij(z)J2J2 A k AiA* k+l _ n exp[i6ki n (z)] + ^g mn {z)\A m \ 2 A n , (1) 



Vn G Z, — L < z < 0, where 7 is the Kerr nonlinear coefficient, a n is the attenuation coefficient around 
<j-Vi, 9mn is the Raman coupling coefficient from the mth to the nth channels, 9 k i n (z) d = f z \j3(C > u>k) + 
/3(£,<x>i) — LOk+l—n) ~ /3(C) w n)]^C denotes the phase mismatch among the mixing waves, and ft± n is a 
functional operator defined as Pi n (z,i-^) d = Ylt=i ( z ' w ") (*'§i) k ■ Using the frame transformation 

(z,t) — > (z,t+ J z P^ 1 ' ((,LUo)d() , (f) may be rewritten as, 

- iPm ( z ^§i) An + A n = il(z)^^A k AiA* k+l _ n cyLj>[iQ kln {z)] + ^ g mn (z)\A m \ 2 A n , (2) 

Vn £ Z, — L < z < 0, with /?2n (z, zjj) = f P\ n ( z >*Jj) ~ P^\ z ^o) This set of equations completely 

determine the propagation dynamics of the optical signals. In case the signals are not co-linearly polarized, 
the mathematical description should be slightly modified to deal with the complication. However, the same 
physics remains to govern the nonlinear signal propagation in optical fibers, still valid are the method of 
nonlinearity compensation described below and the conclusion about the capacity of nonlinear channels. 

When the signals become intense, the nonlinear interaction as evidenced in (2) can badly distort them and 
make the carried information difficult to retrieve. Unlike the case of linear channels [10], simply raising the 
signal power may not necessarily increase the capacity of a nonlinear channel. Nevertheless, the nonlinear 
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interaction among the signals is deterministic in nature that can be undone in principle. The question is how 
to implement a physical device which undoes the distortion. Suppose there is a specialty fiber stretching from 
z — to z = L/R, R > being a constant, in which q(z,uj) is the optical propagation constant. Let a set 
of WDM signals E'(r, t) = F'(x, y) E„ A' n (z, *) ex P \} J* </(Ci W ™)^C ~~ ^'nA propagate in the specialty fiber, 
where \/n G Z, oj' n = uj'q + nA, lo' may differ from too- As in the previous mathematical treatment, define a 

■q(z,w), 



def 



functional operator q 2n {z,i-§ i ) = Efc~ M^K^^n) (*^) ~<l W (z> w o) (*J*)> witn <£ h) {z, <v) 
and let a4, 7', 0jj.j n , denote the linear and nonlinear parameters associated with the specialty fiber and 
the new set of WDM signals, then the propagation dynamics is governed by a similar group of equations, 
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V?i G Z, < z < L/R. If the parameters are set according to the following rules of scaling, 

q (2 \z,uj' Q +uj) = Rf3 {2 \-Rz,uj -uj), Vlu G R, 
a 'n( z ) = —Roi- n {—Rz), Vn G Z, 
i(z) - Rj(-Rz)\C\- 2 , 

9mn( z ) = -Rg-m,-n{-Rz)\C\~ 2 , ^m,Tl£Z, 
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Vz G [0, L/R], C / being a constant, then equations (3) are reduced from (2) by taking the complex 
conjugate, making a substitution z — > —Rz. and replacing A*L n (—Rz,t) by A' n (z,t)/C. Mathematically, 
it says that A' n (z,t) = CA*_ n (—Rz,t), Vn G Z, solve (3), which govern the nonlinear propagation in the 
specialty fiber. Interpreted physically, if OPC is applied after the transmission but before the specialty fibers 
to convert the signals A n (0, t), n G Z, into A' n (0,t) = CA^ n (0 7 t), n G Z, then the specialty fiber will 
propagate the optical signals in a reversed manner with respect to the transmission fiber. At the end, the 
specialty fiber outputs signals A' n (L/R,t) = CA*_ n (—L,t), n G Z, which are replicas of the initial signals 
before entering the transmission fiber up to complex conjugation. The fibers and optical signals on the two 
sides are said to be mirror symmetric about the OPC, although in a scaled sense. Note that the specialty 
fiber would amplify light in correspondence to the attenuation in the transmission fiber and vice versa. 
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Fig. 1. A specialty fiber and a transmission fiber are in scaled mirror symmetry about the point of OPC. The 
shaded fiber segments are located at —z and Rz respectively, < z < L/R, with the parameters g' 2 ^(— z), 
a'(-z), -y'(-z), g'(-z) proportional to ^(Rz), a(Rz), -y(Rz), g(Rz) as in (4-7). 

So OPC and a specialty fiber with parameters designed according to (4-7) could perfectly compensate the 
nonlinearity of a transmission fiber, if not for the ever-existing noise, especially that incurred when the 
signal amplitude is low, destroying the mirror symmetry. A better designed link would start with a specialty 
fiber that boosts the power of the optical signals, followed by OPC, then a fiber for transmission in which 
the signal power decreases, as shown in Fig.l. In the fiber locations not too far from the OPC, the signal 
power is relatively high to minimize the effect of the optical noise, which usually originates from amplified 
spontaneous emission (ASE) and quantum photon statistics. However at the two ends of the link, the effect 
of the optical noise could become substantial. A simple but fairly accurate model may assume that optical 
noise is incurred exclusively at the two extreme ends of the link, dispersive and nonlinear signal propagation 
is the only effect of the inner part of the link. In this model, the nonlinearity of a segment of transmission 
fiber with Z\ < z < z 2 is fully compensated by the portion of the specialty fiber with —z 2 /R < z < —Z\/R, 
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\/z\,Z2 G [0, L]. In particular, the entire link from z = —L/R to z = L is equivalent to a linear channel 
impaired by additive noise at the two ends. If W is the total optical bandwidth of the input WDM channels, 
then the OPC should have a bandwidth wider than W to cover the extra frequency components generated 
through wave mixing in the specialty fiber. With nonzero dispersion fibers, however, the extra bandwidth due 
to wave mixing may hardly exceed 100 GHz, which is often negligible in comparison to the total bandwidth 
W of several, even tens of THz. Thus the linearized link may be assumed to have the same bandwidth limit 
W throughout, applicable to which is Shannon's formula for channel capacity [10], C = W\og 2 {l + S/N). 
Obviously, many of such linearized links may be cascaded to reach a longer transmission distance, and the 
entire transmission line is still linear end-to-end in spite of the nonlinearity existing locally in the fibers. 

Using a commercial software, computer simulation has been carried out to test the proposed method of 
nonlinearity compensation. As in Fig.l, the simulated link consists of a specialty fiber, an OPC, and a 
transmission fiber that is of the negative nonzero dispersion-shifted type, 200 km long, with loss coefficient 
a = 0.2 dB/km, dispersion D = —8 ps/nm/km, dispersion slope S = 0.08 ps/nm 2 /km, effective mode area 
A e ff = 50 /itm 2 , Kerr and Raman coefficients that are typical of silica glass. The specialty fiber is a dispersion 
compensating fiber of the same material, but with parameters (a' , D' , S') — 20 x (—a, D, —S) and A' cff = 12.5 
/im 2 . The nonlinearity of the specialty fiber can be switched on and off. ASE noise is added at the two ends 
of the link. The input consists of four WDM channels at 100 GHz spacing, all RZ modulated at 10 Gb/s 
with 33% duty. The power of all optical pulses is peaked at 100 mW when entering the transmission fiber. 
Fig. 2 shows the received signals without and with nonlinearity in the specialty fiber respectively. Showing 
no nonlinear degradation, only the effect of ASE noise, the graph on the right side demonstrates clearly the 
compensation of optical nonlinearity. 
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Fig. 2. Received signals at the end of a simulated link. Left: only the dispersion of the transmission fiber is 
pre-compensated by the specialty fiber. Right: both dispersion and nonlinearity are pre-compensated. 
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